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@ Image processing apparahia. 



©Imaae pcocessina appaatus comprises an Input device Including an Indicator (31) and a aiiface(5) 
ovHSiAtiteMc^^ A host (1) detemiinas the position of the indlc^l) on fte surfe^ 
(5) and also the fbrce by which the indicator Is placed onto the aiMface. Frame stores (22)^^re digital 
Ste^ft^ the colouf component content of an bnaga The host (1) simulalM an eledronte pairt 
bnish carrying paint whose characteristics are detennined at least In part In accordance virflh the force 
of the indicater (31) on the surface (5). 
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Th invention relates to image processing 
apparatus. 

In accordance with the present Invention, innage 
processing appaiatua comprises an input device 
Including an indicator and a surface over which the 
Indicator is moved; posi&>n determining means for 
determining the position <tf the indicator on the w- 
fac^ a force monitor for monitoring the force with 
which the indicator is pressed onto the surface; a 
frame store for storing digital dafa defining the colour 
component content of an image; and processing 
mearm connected to the Input device and the finame 
store for sbnuiating an electronic paint brush carrying 
paint which is laid down fri thefirame store at locations 
corresponding to the positions of the indicator on the 
surface and whose characteri^ics are determined at 
least In part in accordance wfth the force monitored t>y 
the force monitor. 

We have developed a new type of bnage proces- 
sing apparatus which enatiles many interesting and 
unusual effecte to be achieved in which the diaracter- 
Istics of the paint carried by the paint bru^ are deter- 
mined at least in part by the force with which the 
indicator Is pressed onto the surface. Examples of 
paint characteristics include hue, br^htness and 
saturatton. A particularty advantageous application 
involves modifying brightness and saturation whDe 
mainteining hue constant 

The Invention ts applicable to nx>difylng omages 
which have been scanned using a conventional elec- 
tronic scanner but is particularly applicable to images 
which are created electronicaDy by use of the input 
device. The invention can be u^ to create an triage 
in the frame store or to ntodify an existing image in 
which tiie new paint is combined with previous paint 
in a known manner. 

Preferably, the processing means applies to tiie 
monitored force value a colour selection function for 
each colour component, the colour selection function 
denning the variation in chaFacteristic(s} of the corre- 
sponding colour component with monitored force. 

Preferably, tiie colour selection function is dis- 
continuous and defines odour component values far 
spaced groups of force values. Thus, in this case, 
ttiere w3l be certain force values fn* which a colour 
component value of zero Is obtained. 

Ottier forme of tiie colour selection function are 
also possitde so that for example the function can 
define a straight or curved variation or be non-unifonn 
and can vary etther in a oontroQed manner or in a ran- 
dom manner, for example separate Gaussian varia- 
tions in each colour channel. That is each component 
could have a random offaet added or sutitracted from 
tiie current colourvalue, tiie probability of any particu- 
lar offset b Ing e.g. Gaussian. The pen pressure 
would be used to modulate tiie Nvidtti of the Gaussian 
curve, witii hard pressure giving a higher probabnity 
of getting a gh«n, large change from the "base" col- 



our. 

Wh retii image is defined by mors than one col- 
our component, the associated colour selection func- 
tions are preferably differBnt 
5 The processing means defines, In a conventional 
manner, the shape, size and density profile of the 
brush. 

Typically, the indicator comprises a pressure pen 
and tiie surface is define by a digitising teblet Ottier 
10 forms of input device, however, are also possible. 

Preferably, tiie apparatosfurtiier comprises adis- 
piay connected to the frame store so as to display the 
image defined by digital date In tiie frame store. 
The processing mearra may be provided by a sult- 
15 ably programmed computer or by hard wired circuits. 
An example of Image processing apparatus 
according to tiie Invention will now be described witii 
reference to tiie accompanying drawings. In whlch:- 
Figure 1 is a block diagram of ttie apparatus; 
20 Figure 2 is a block dlagrsm of tiie graphics image 
processor of Figure 1 ; 

Figures ZMO iOu^te four different colour 
selection functions; and. 

Figures 4A-4D Illustrate four further colour seleo- 

25 tion functions. 

The apparatus shown in Figure 1 can be divided 
into two primary parts. These comprise the host 1 and 
tiie graphics sub-system Z The division is shown in 
FIgurel byadashed line. The host1 isa68Q20micro- 

30 processcM* based system running UNIX which Is a mul- 
ti-tasking, multi-user operating system. The ho^ 
comprtes an I/O processor 3 coupled to a keyboard 
4, a digitizing tablet 5 and assodated pen 31, a sys- 
tem disk 6 and otiter date sources (not shown). The 

35 I/O processor 3 is connected to a system inter-con- 
nect bus (SIB) 7 whteh Is connected to ROM and RAM 
memory 8, a CPU 9, and an Interface adapter 10. The 
interface adapter 10 *a connected to a number of high 
speed bnage discs 11 which hold data defining tiie 

40 cdiour content of pbcels of imagee at high resdution, 
tiie adapter also being connected via an interface 12 
witii tiie graphtes sub-system Z As mentioned above, 
tiie host has a conventional form and wiO not be des- 
cribed in detafl. However, tiie SIB 7 is described in 

45 more detei in EP-A-0332417. 

The programme that runs on the host is a single 
'process' which reads and processes inpute from tiie 
digitizing tablet 5 under operator control and directe 
tiie graphics part 2 to display ttie hosf s responses to 

50 tilose Inpute on the graphics monitor 30. Essentially, 
tiie system takee advantage of the host system in 
being able to perform a majority of the calculations so 
ttiat only a small amount of control date is passed to 
tiie graphics sub-system. This graphics part 2 Is much 

58 better ttian tti host 1 at creating and manipulating 
graphical objecte but ttie host is better at controlling 
input/output to peripherals, discs and tapes and Is 
relatively easy to pro^emme. 
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Th graphics sub-systBm 2 oomprises an intar- 
face 13 which connects the graphics part to th host 
1, the interfeca 13 being connected to a bus 14. The 
bus 14 is connected to five graphics image proces- 
sors (GIPs) 15-19. In this embodiment, it Is assumed 
that tfie Images are defined by four colour cccnpo- 
nents, namely magenta, yellow and blade, there 
being a sepaffate dP for each colour. Thus, the GiP 
1 5 processes the ^an colour component, the GIP 16 
the magenta colour component, the GIP 1 7 the yellow 
colour component and the GIP 18 the black colour 
con^nent If the image was represented by a dtffe- 
rent number of colour components, for example red, 
green and blue then only three of the GIPs would be 
needed. The advantage of providing the GIPs 15-18 
in paraDe! te that each component of each pixel In the 
image can be processed in parallel so that the overall 
processing time is reduced by up to four times over 
the procesting time with a single processor. A further 
advantage of using the QlPs is that each has a bit- 
slice processor on which the progranuner can define 
instructlona useful for a particular application. 

Afifth GIP 19 is provided for defining one <tf more 

masks and other features. 

Theconstnidlonofonetf the GIPs of Figure 1 is 
shown In Rgure2. Each GIP comprises a bit-slice pro- 
cessor 20 coupled to bulk memory 21. This memory 
21 win hold image data, brush profaes and text as 
required and is used as virtual Image memory. 

The bi^slice processor 20 is also connected to a 
pair of firamestorss 22, 23 each of which has dimen- 
sions 1280x1204 and is 8 bte deep. In the GIPs 15- 
1 8, each framestors will hold 8 bft colour data whHe in 
the mask GIP 1 9 each lhamestore can be used to hold 
8 bit nrnsks or two separate 4 btt masks. Furthermore, 
one of the frantestores in the GIP 19 can be used to 
display menus In onefbur bit plane and overlays In the 
other four bit plane. Overlays comprise construction 
lines and boxes and the like which are to be displayed 
on the monta. 

The eight bit data in each framestore 22, 23 is 
applied In four bit "nibbles* to respective scroll, 
amplify and zoom drcuBs 24-27 which operate in a 
conventional manner to perfonm one or more cS the 
functions of scrofl, zoom and amplHy, the outputs firom 
these cfircufte being fdd to a mbcer circuit 28. The cir- 
cuit 28 mbces the data firom each of theframestores 
22assodatedwilhthe GIPs 15-18 with the data from 
each of the firame stores 23 associated witti the GIPs 
15-18 in accordance vnth the mask stored In the 
framestcTO 22 of the GIP 19. This ntor circuit which 
operates in two sts^ea la described In more detaQ in 
EP-A-0344976. 

The outputfirom the mbcer circuft 28 Is fed to a two 
stage colour converter 29 which converts the four col- 
our component data to ttuee colour component data 
e.g. red, green and blu suitabl for oontroiling the 
display on a monitor screen 30. 



In use. Images are stored on the high speed 
imag disks 11 and these Images may have been 
generated by scanning original transparencies or 
other representations or they may have been created 

5 electronically using an electronte paint brush. The 
host 1 causes relevant portions of these bnages to be 
*paged* In and out of the tnjlk menrory 21 in the GIPs 
15-18 and brush proffles to be loaded and unloaded 
from the bulk memory 21 in the GIP 19. The interface 

10 adaptor 10 has its own 68020 processor to allow it 
Independently to control the disks 1 1 . The GIPs 1 5-1 8 
ara directed by the host 1 to do various things to 
images in the bulk memory 21 so that when a GIP 
attempts to access an address la an Image that is not 

15 currsntiy in its bulk 'memory then part of timt menmiy 
Is written back to disc and a new portion read in. After 
the GIPs have finished processing, the data fai the 
framestores is then scroiled, zoomed and/or amplified 
as necessary, mbced in the circuit 28, converted to 

20 monitor format and then displayed. 

If the host 1 wishes to display menus on the 
screen, these are drawn into the maskGIPfiramestore 
23, known as fiie 'overlay plane'. 

The digitising tablet 5 nd only Indicates the cur- 

25 rent location of the pen 31 but also the pressure with 
which the pen Is applied to the taU^ This pressure 
is contained within a seven digit data field allowing 
128 pos^e pressure levela The pressure value is 
taken by the host 1 and is used to address rsspect^e 

30 look-up tat^es \n the memory 8. Tliese look^jp tables 
define the colour components of the colour to be used 
by the paint brush generated by the GIPs 15-18. 

Rgures 3A-3D Hhjstrate by way of example four 
different cokxir selection functkms which are 

35 associated with the cyan, nrtagenta, yelk>w and black 
colour components respecthrely. Each look-iip table 
has a set of addresses corresponding to aO possible 
pressure values, typicaQy 128, and In each address a 
density value to stored as defined by the appropriats 

40 function. It wOi be noted that In these examples each 
colour selection functkui is discontinuous (although 
thte win not always be the case) and for each colour 
component there are certain pressure values which 
result in a zero density value. It wDl be noted, how- 

45 ever, that the four functtons are different 

Figures 4A4D nhistrate four further colour selec- 
tion functkms. 

In operatkm, the operator or artist moves the 
pressure pen 31 across the tablet 5 and the host 1 

50 monttora the appHed pressure. The pres»ire signal to 
sampled regularly and In response to each pressure 
sample the look-up tables are addressed and the 
appropriate colour component values accessed. 
These values are then used after modiTication by the 

55 density profDe of the selected 'brush", to lay down 
paintlnth firame storee 23. The result to dtoplayed on 
the monitor 30 after combination with any Inutge In th 
frame stores 22. 
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Th irwentton can have the effect of wofWng with 
a muItWayer scraper Ixjard, given suMU look-up 
ftincltons.Thatls,ltgtvestheappearancethatth har- 
der the applied pressure the more teiyers are scraped 
away to reveal a particular colour. If the bmsh has a 
curved density profile then the cdoiffs which have 
been soaped away would stiQ remain visible at the 
edges of the bnjsh so that the artet can soon learn to 
pass from a doodling mode In which colours flow 
rather like a oB film on water, to a controlled artistic 
mode in whteh selected cdoure can be pushed In a 
chosen direction. 

In one applicatton, the host 1 oodd respond to the 
detectton of two dHfaerfe presswes at spaced posi- 
ttons across the tablet 5 to generate automatically a 
linear vignette of colour varying between the colours 
defined by the two pressures. 



Claims 

1 . Image processing apparatus comprising an input 
device including an Indicator ^1) and a surfece 
(5) over which the indicator is moved; position 
detemilnlng means fbr determining the position of 
the indicator on the surface; aforce monitor (3) for 
monitoraig the force with which the Indteator is 
pressed onto the surfece; a firame store (22) fbr 
storing digital data defining the colour component 
content of an Image; and processing means (3) 
connected to the input devk» and the frame store 

simulating an electronic paint brush carrying 
paint which is laid down in the tane store at loca- 
tions corresponding to the posltkms of the Indi- 
cator on the surface and whose characteristics 
are detennined at least in part In accordance with 
the force monitored by the force monitor. 

2. Apparatus acccmiing to dalm 1. wherein the 
characteristice are chosen linom hue, brightness 
and saturaSon. 

3. Apparatus according to daim 2, wherein the pro- 
cessing means is adapted to maintain hue con- 
stant while modl^ brightness and saturation In 
accordance with the monitored force. 

4. Appaatus according to any of the preceding 
dalma, wherein the processing means applies to 
the monftored force value a colour selectten funo- 
tion fbr each colour component, the cdour selec- 
tion fundton defining the variation in 
characleristic(s) of the corresponding colour 
component with monitored force. 

5. Apparatus according to da'on 4, wherein the col- 
our selection function is discontinuous and 
defines cdour component values for paced 



groups of force values. 

e. Apparatus according to daim 4 or daim 5, whe- 
rein th image ie defined by more than necol ur 
component, the associated colour selectton ftmo- 
tions being different 

7. Apparatus according to any of the preceding 
cla'ffns, further comprising a display (30) connec- 
ted to the frame store (22) so as to display the 
Image defined tiy d^ital data In the frame store. 
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Th Invention can have the effect of working with 
a muttHayer scraper t>oard, given suitatil look-up 
functk)ns.Thatls,ltglve8th appearancethatth har- 
der the applied pressure the more layers are scraped 
away to reveal a particular colour. If the bmsh has a 5 
curved density profDe then the cdoure which have 
been scraped away would stiD rentain visible at the 
edges of the brush so that the artist can soon learn to 
pass from a doodling mode in which colours flow 
rather Ilka a oO film on water, to a controlled artistic 
mode in which selected cdoura can be pushed in a 
chosen directton. 

In one applk:atk)n, the host 1 could respond to the 
detection of two different pressures at spaced posi- 
tions across the tablet 5 to generate automatically a 
linear vignette of colour varying between the cdoura 
defined by the two pressures. 



Claims 

1 . Image processing apparatus comprising an input 
device including an indk:ator (31) and a surface 
(5) over which the indicator is moved; position 
detenminir^ means for detennining the positkm of 
the indlcatoron thesurfiaoe; afoice monitor (3) for 
monitoring the fbrce with which the indk:ator is 
pressed onto the surfece; a frame store (22) for 
storing digital data defining the colour component 
content of an image; and i^ocessing n»ans (3) 
connected tothe inputdevice and the frame store 
for simulating an electronic paint brush carrying 
paint which la laid down in the frame store at loca- 
tions correspond'ong to the posittons of the Indi- 
cator on the surface and whose characteristics 
are detennlned at least in part In accordance with 
the force monitored by the fbrce monitor. 

2. Apparahis according to daim 1, wherein the 
characteristics are chosen from hue, brightness 
and saturaticiv 

3. Apparatus according to daim 2, wherein the pro- 
cessing means is adapted to maintain hue con- 
stant whPe nKxlifylng brightness and saturatton in 
accordance with the n»nitDrsd force. 

4. Apparatus according to any of the preceding 
daims, wherein the processing means applies to 
the monftored fc»ce value a odour selection fUno- 
tion for each odour component the odour sdeo- 
tion fiinctkm definihg the variation in 
charactert8tlc(s) of the corresponding colour 
component with monitored force. 

5. Apparatus according to dalm 4, wherein the oo^ 
our selection fUnctton is dlscontlnu us and 
defines odour component values for spaced 



groupe of force values. 

6. Apparatus according to daim 4 or dafan 5, whe- 
rein the frnage ie defined by more than one colour 
component, the associated odour selectton func- 
tions bdng different 

7. Apparatus according to any of the preceding 
claims, further ccmiprlsing a display (30) connec- 
ted to the tirame store (22) as to display the 
image defined by digital data in the frame store. 
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Fig. 3 A, 
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@ Image processing apparatus. 

@ Image processing apparatus comprises an 
input device including an indicator (31) and a 
surfece (5) over which the indicator is moved. A 
host (1) detemiines the position of the indicator 
(31) on the surface (5) and also the force by 
which the indicator is placed onto tiie surface. 
Frame stores (22) store digital data defining the 
colour component content of an image. The 
host (1) simulates an electronic paint bmsh 
canying paint whose characteristics are deter- 
mined at least in part in accordance with the 
force of the indicator (31) on the surface (5). 
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